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Short-Range  Forecasting  of  Cloudiness  and 
Precipitation  Through  Extrapolation  of 

GOES  Imagery 


1.  INTRODUCTION 

An  admitted  deficiency  in  meteorology  is  the  limited  ability  to  forecast  sudden 
changes  in  weather  conditions.  In  the  past,  forecasters  blamed  the  combination 
of  small-scale  complexities  in  the  weather  patterns,  and  the  large  spacing  in  the 
observing  network.  Now,  with  the  high  resolution  of  satellite  imagery  data  as 
well  as  ground-based  radar  data,  this  excuse  is  no  longer  valid,  and  there  are 
ample  opportunities  to  develop  short-range  prediction  techniques. 

An  effort  has  been  underway  at  Air  Force  Geophysics  Laboratory  (AFGL)  to 
utilise  satellite  information  in  short-range  forecasting.  The  first  objective  tech¬ 
nique  to  be  explored  is  that  of  simple  extrapolation,  in  which  the  basic  weather 
patterns  are  assumed  to  move,  unchanged,  in  a  simple  straight  line.  To  make  a 
forecast,  one  requires  a  means  to  determine  the  motion  vector,  a  procedure  to 
use  the  motion  vector  to  forecast  satellite  imagery  parameters,  and  algorithms 
to  convert  the  imagery  parameters  to  surface  weather  conditions.  This  report 
will  describe  a  test  of  the  extrapolation  concept,  operating  in  an  automated  mode. 
The  first  step  is  the  construction  of  a  forecast  model.  Next  is  the  compilation  of 
satellite  and  weather  data,  followed  by  computer  execution  of  the  forecast  model. 
Finally,  there  is  the  presentation  of  verification  scores  and  a  discussion  of  the 
results. 

Received  for  Publication  14  July  1981 


2.  EXTRAPOLATION  TECHNIQUES 


Simple  extrapolation  of  weather  patterns  has  been  an  important  forecast 
technique  for  over  100  years.  To  make  forecasts  of  largo  areas,  one  uses  a 
series  of  weather  charts,  often  12  hours  apart,  and  notes  the  motion  of  signifi¬ 
cant  features  such  as  fronts,  pressure  centers,  "thickness"  contours,  or  jet 
streams.  The  forecaster  then  extrapolates  the  positions  of  those  features  12, 

24,  or  3G  hours  into  the  future,  and  draws  up  a  "prognostic"  weather  chart.  For 
many  years,  weather  centrals  have  been  preparing  and  disseminating  prognostic 
charts  with  12-hour  time  intervals  out  to  about  48  hours.  While  these  charts 
are  convenient  for  viewing  the  "whole  picture,  "  the  coarse  temporal  resolution 
requires  that  the  forecaster  must  make  careful  temporal  and  spatial  interpolations 
for  local  operational  forecasts. 

The  extrapolation  techniques  can  also  be  applied  to  a  specific  location  to  pro¬ 
duce  local  forecasts  of  high  temporal  resolutions.  An  example  of  such  a  scheme 
applied  to  satellite  imagery  is  shown  schematically  in  Figure  1.  From  a  sequence 
of  satellite  images  (visual  or  Ill  digital  data),  a  motion  vector  is  determined  by 
comparing  the  positions  of  features.  Next,  the  motion  vector  is  reversed  in 
direction  and  one  marches  "upstream,  "  converting  distance  in  the  image  to  time, 
by  using  the  speed  of  the  motion  vector.  For  example,  if  the  pattern  is  moving 
at  15  trips  (30  kts)  the  condition  to  expect  in  one  hour  exists  now  >4  km  (30NM)  in 
the  upstream  direction.  One  then  makes  forecasts  of  satellite -measured 
parameters  (visible  or  IR  brightness)  at,  say,  half-hour  intervals  as  far  out  into 
the  future  as  one  might  expect  both  the  pattern  and  motion  to  remain  unchanged. 
The  final  step  is  to  convert  the  forecast  satellite  parameters  to  surface  weather 
conditions,  and  one  then  has  a  detailed  short-range  forecast. 


3.  TEST  FORECAST  MODEL 


3.1  Model  Structure 

The  basic  extrapolation  principle  is  used  currently  in  an  AWS  operational 
cloud  forecast  model1  and  also  in  a  McGill  University  precipitation  model1*! 


‘^Computer  models  have  replaced  the  synoptic  meteorologists  at  these  centrals, 
but  the  output  prognostic  charts  are  similar. 

1.  Tarbell,  T.  C.  and  Hoke,  J.  E.  (1980)  The  automated  analysis/ forecast 
model  system  at  the  Air  Force  Global  Weather  Central,  Proc.  AMS 
Eighth  Conference  on  Weather  Forecasting  and  Analysis,  pp.  262-269, 


2.  Bellon,  A.  and  Austin,  G.  L.  (1978)  The  evaluation  of  two  years  of  real¬ 
time  operation  of  a  short-term  precipitation  forecasting  procedure 
(SHARP).  J.  Appl.  Meteor.,  17:1778-1787. 


-  < -1 


PROB.  OF 
PRECIP. 


While  these  operational  models  were  not  designed  to  produce  local  forecasts  with 
high  temporal  resolution,  they  each  contain  some  of  the  features  illustrated  in 
Figure  1,  and  provided  a  basis  for  this  test  forecast  model.  As  can  be  seen  in 
Figure  1,  there  are  three  separate  steps  leading  to  the  production  of  the  local 
weather  forecast.  The  first  stop  consists  of  determining  the  speed  and  direction 
of  cloud-system  motion.  Next,  the  satellite  image  is  used  to  produce  a  series  of 
forecast  satellite  parameters.  Finally,  the  satellite  parameters  are  converted 
pertinent  weather  variable  a. 

3,2  Motion  Veetor* 

Several  groups  have  developed  computer-based  techniques  to  derive  motion 

3  4 

vectors  from  sequences  of  satellite  images  *  .  The  principal  application  of  these 
techniques,  however,  has  been  to  estimate  upper-level  winds  in  data-sparse 

r  /* 

regions.  In  the  reports  1  Muench  and  Hawkins, '  and  Muench,  several  candidate 
techniques  were  evaluated  for  their  suitability  for  use  in  an  automated  short-range 
forecast  model  based  on  extrapolation.  These  techniques  included  a  "cloud¬ 
tracking"  technique,  a  fast-Fournier-transform  cross-covariance  technique,  and 
a  binary  cross -covariance  technique.  In  addition,  winds  aloft  at  700  and  500  mb 
were  tested  as  possible  motion  vectors. 

All  of  the  basic  techniques  worked  well  when  the  cloud  patterns  were  near 
the  center  of  the  working  arrays.  Only  the  binary  cross-covariance  technique, 
however,  worked  equally  as  well  when  the  cloud  patterns  were  predominately 
near  the  edges  of  the  arrays.  In  an  interactive  application,  an  operator  could 
center  the  array  manually  over  a  cloud  pattern,  but  such  positioning  would  not 
be  simple  in  an  automatic  mode.  Another  result  was  that  either  a  recent  700-m'o 
wind  or  one -half  the  500-mb  wind  produces  forecasts  nearly  as  good  as  those 
produced  by  covariance  uerived  motion  vector  and,  in  many  instances,  the  upper- 
level  winds  can  be  obtained  more  easily.  In  view  of  these  results,  the  binary 


3.  Leese,  J.  A.  and  Novak,  C.  S.  (1971)  An  automated  technique  for  obtaining 

cloud  motion  from  geosynchronous  satellite  data  using  cross -correlation. 

J.  Appl.  Meteor. ,  10:118-132. 

4.  Wolfe,  D.  E.,  Hall,  D.  J.,  and  Endlich,  R.  M.  (1977)  Experiments  in  auto¬ 

matic  cloud  tracking  using  SMS-GOES  data,  J,  Appl.  Meteor,,  16:1219-1230. 

5.  Muench,  H.  S.  and  Hawkins,  R.  S.  (1979)  Short-Range  Forecasting  Through 

Extrapolation  of  Satellite  Imagery  Patterns,  AFGl,-TR-7&-0o9g, 

ADA<m081, 

6.  Muench,  H.  S.  (1979)  Short-Range  Forecasting  Through  Extrapolation  of 

Satellite  Imagery  Patterns  Part  it,  Testing  Motion  Vector  Techniques, 
AFGL-TR-?9-(5z94,  ADA"  68 66 6 2. 
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cross -covariance  and  the  700  -mb  wind  techniques  were  chosen  in  this  test  to 
forecast  surface  weather  conditions  using  satellite  data. 

Objective  forecast  techniques  using  extrapolation  have  been  developed  for 

7  8  2 

weather  radar  data  bases,  both  experimentally  *  and  operationally.  A  common 
problem  is  that  successive  pairs  of  Images  often  yield  motion  vectors  that  oscil¬ 
late  in  time,  and  one  would  expect  that  a  more  stable  motion  vector  would  produce 
more  reliable  forecasts.  An  obvious  solution  is  to  perform  a  time-average  on  a 
series  of  motion  vectors,  and  for  this  test,  a  "running-time"  average  was  adopted. 
At  each  time  step,  the  average  was  updated  by  adding  30%  of  the  latest  motion 
vector  to  70%  of  the  old  average  motion  vector.  When  a  test  case  is  started,  there 
is  no  old  average  motion  vector,  so  the  first  average  motion  vector  was  50%  of 
the  7 00 -mb  wind  and  50%  of  the  first  motion  vector.  Table  1  shows  the  contribu¬ 
tion  of  each  computed  motion  vector  to  the  time  average  at  different  time  steps 
after  the  case  was  started. 


Table  1.  Contribution  of  Computed  Vectors  to  Running  Time  Average 


3.3  Forrcartiny  Satellite  Parameters 

Once  having  established  a  motion  vector,  a  procedure  can  be  programmed 
easily  to  reverse  the  vector  and  look  upstream  in  an  array  of  either  visible  or  IR 

r 

data  to  determine  what  values  will  arrive  at  which  time.  A  previous  test  indi¬ 
cated  that  skill  relative  to  persistence  was  small,  but  increasing  with  time  out 
to  3  hours.  For  this  follow-on  test,  the  forecast  time  was  extended  to  7  hours. 
To  assure  temporal  resolution,  half-hourly  time  steps  were  chosen,  even  though 


7.  Muench,  H.  S.  and  Lamkin,  W.  E.  (1976)  The  Use  of  Digital  Radar  in  Short- 
Range  Forecasting,  AFGL-TR-76-0173,  ADA033624. 

Hrowning,  K.  A.  (1980)  Radar  as  part  of  an  integrated  system  for  measuring 
and  forecasting  rain  in  the  l.;K:  progress  and  plans.  Weather,  35,  pp.  94-104. 
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this  meant  that  only  half  of  the  forecasts  could  be  verified  by  the  airways 
observations  taken  "on-the-hour.  "  If  one  is  to  make  a  forecast  for  the  Ith  half- 
hour  time  period,  he  would  look  upstream  a  distance  z  defined  by 

Z  *  c  .  s  .  1 


where  c  is  the  speed  of  the  motion  vector,  and  s  is  the  scale  factor  that  converts 
to  units  of  grid  distance. 

Of  course  it  would  be  very  unlikely  that  t  ie  point  at  the  distance  z  upstream 
would  be  found  to  lie  exactly  on  top  of  a  gridpoint  of  satellite  data,  and  some 
interpolation  would  be  necessary  using  data  from  surrounding  gridpoints.  Also, 
we  must  recognize  that  there  are  uncertainties  in  both  the  direction  of  the  vector 
and  the  speed.  To  allow  for  these  uncertainties,  we  should  include  more  of  the 
surrounding  gridpoints  in  the  interpolation,  particularly  for  . »  longer  time  inter¬ 
vals.  (Large  value  of  I.)  In  this  model,  a  9  x  9  array  of  gridpoints  was  used, 
surrounding  the  upstream  point  at  the  time  interval  I.  At  each  of  the  81  points, 
a  weighting  function  was  computed,  based  on  the  distance  from  the  upstream  point 
(near  the  center  of  the  9x9  array),  as  well  as  the  time  interval.  If  the  distance 
from  the  gridpoint  i,  j  to  the  upstream  point  is  pj  j  then  the  weighting  function 

W.  •  is  computed  by 
J 

W,  .  =  y  /(  Y  +  pf  ■) 

J  1.  .1 

Y  =  (  0.  4  +  c  *  s)  ♦  I  +  0.  10  . 


This  formula  compensates  for  errors  of  about  20%  in  speed  and  15°  in  direction. 
Characteristics  of  the  weighting  function  can  be  seen  in  more  detail  in  Figure  2. 
The  weighting  function  approaches  1.0  at  long  time  intervals,  and  puts  nearly 
all  the  weight  on  the  four  nearest  points  for  the  shortest  time  intervals.  To 
compute  a  forecast  of  a  satellite  parameter,  for  example,  the  visible  reflectivity 
Rf,  then 
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Figure  2.  Weighting  Function  for  Points  in  9  x  9 
Array  Surrounding  ,TUpstream"  Point,  as  a  Function 
of  Forecast  Time  and  Distance 
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3.4  Convenient  to  Surface  Weather  | 

|  Given  forecasts  of  visible  reflectivity  and  IR  emission,  one  needs  algorithms  1 

*  to  convert  these  forecast  parameters  to  their  equivalent  surface  weather  condi-  I 

tions.  In  choosing  the  weather  elements  to  forecast  there  were  three  important  | 

|  considerations:  | 

|  i.  Which  elements  are  most  directly  related  to  reflectivity  and  IR  emission?  | 

fj  ;  ii.  Which  elements  are  of  greatest  importance  to  airfield  operations? 

|  iii.  Which  elements  can  be  most  readily  verified  by  observations? 

H  ! 

The  first  element  to  be  chosen  was  cloud  amount.  To  determine  cloud  amount 

■  from  satellite  digital  data,  a  natural  approach  would  be  to  start  with  am  array  of 

j  : 

1  data  similar  in  size  to  the  area  seen  by  a  ground  observer  --  roughly  a  20-km 

' '  diameter  circle.  Then  one  would  use  the  finest  resolution  data  available  and 

| :  simply  count  the  number  of  "bright"  values,  and  divide  the  total  by  all  values  to 

|  J  get  the  cloud  coverage.  There  are  two  problems  with  this  approach.  First, 

j  s  clouds  have  resolution  much  smaller  than  the  finest  satellite  resolution  routinely 

i  < 

]t 

'  <  13 

:  i 

! 


M 

*  ' 


available,  A  "bright"  value  of  even  half-mile  resolution  data  might  be  made  up 
of  some  clear  sky  and  some  "very  bright"  clouds,  or  it  might  be  uniformly  "bright" 
clouds  —  there  is  no  obvious  way  to  tell.  Second,  there  is  a  continuous  spectrum 
of  sky  reflectivities  (and  IR  emissions)  from  dark,  clear  skies,  to  light  haze,  to 
thin  clouds,  all  the  way  to  bright,  dense  clouds.  There  is  no  physically  obvious 
threshold  to  define  where  in  the  satellite  imagery  the  "clear"  ends  and  the  "clouds" 
begin.  The  threshold  depends  on  the  problem  at  hand. 

Q 

Muench  and  Keegan  approached  the  problem  of  determining  cloud  cover  by 
simply  relating  observed  "opaque"  cloud  cover  to  the  satellite -observed  reflec¬ 
tance,  starting  with  clear  conditions  and  single -layer  cloud  cover.  Data  from  that 
study  were  extended  by  including  some  multiple -layer  cloud  data,  to  determine 
thresholds  separating  "clear,  "  "scattered,  "  "broken,  "  and  "overcast"  sky  condi¬ 
tions.  Figure  3  shows  the  resulting  thresholds,  in  terms  of  normalized  reflecti¬ 
vity  and  equivalent  IR  temperature.  ** 


Figure  3.  Thresholds  Separating  Cloud  Amount  Categories  as  a  Function 
of  Reflectivity  and  IR  Temperature 


*  Normalization  corrects  for  solar  geometry  and  anisotropic  scattering. 

**  Equivalent  IR  temperature  from  "Standard  IR  Calibration,  "  Appendix  II, 
Attachment  A3,  Corbell,  Callahan  and  Kitsch  (1978)  The  GOES/SMS 
Users  Guide,  NOAA/NESS. 

9. 

Muench,  H.  S.  and  Keegan,  T.  J.  (1979)  Development  of  Techniques  to 
Specify  Cloudiness  and  Rainfall  Rate  Using  GOES  Imagery  Data. 
Af6L-'TR-i79-0255,  ADA084757. 
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In  computing  the  cloud  condition,  the  model  starts  with  a  normalized  reflecti¬ 
vity  (forecast)  R^  and  an  equivalent  IR  temperature  Tg  (degrees  C).  A  parameter 
B  is  computed  by 

B  =  110Rf  /  (  120  -  T  ) 

and  a  "minimum”  or  Bn  is  computed  by 

Bn  =  B  -  2  a  Rf 

where  a  Rf  is  the  standard  deviation  of  reflectivity.  The  definitions  for  the  cloud 
categories  in  terms  of  B  and  Bfi  are  shown  in  Table  2. 


Table  2.  Definitions  of  Cloud  Amount  Categories, 
Relative  to  the  Parameters  "B"  and  "Bx" 


Category 

Sky  Cover 

Limits 

Clear 

o/io 

0. 14  >  B 

Scattered 

1/ 10-5/ 10 

0.20  >  B  >  0. 14 

Broken 

6/ 10-9/ 10 

0.40  >  B  >  0.20 

or  B  >  0. 40  and  B  s  0.  30 

Overcast 

10/ 10 

B  >  0.40  and 

B  >  0.30 

n 

g 

Included  in  the  report  by  Muench  and  Keegan  is  a  study  of  the  relation  be¬ 
tween  satellite -observed  parameters  and  surface  rainfall.  The  study  was  based 
on  widespread  precipitation  rather  than  summertime  convective  precipitation, 
and  should  be  suitable  for  use  with  mid -latitude  traveling  storm  systems.  In 
the  study,  the  relation  is  presented  as  isopleths  of  probability  of  0.01  (0.25  mm) 
of  rain  the  following  hour,  in  terms  of  normalized  reflectivity  and  IR  equivalent 
temperature. 

To  parameterize  the  relation,  the  reflectivity-IR  diagram  was  first  split 
into  two  areas  by  the  line 


R,  =  (  32  -  T  )  /  90 


The  probability  of  precipitation  for  one  hour  PoP^  can  then  be  approximated 
by: 

for  Rf  *(32  -  T  )  /  90, 

PoP1  =  exp  (-11.2  (  1  -  Rf)2) 

for  Rf  >  (32  -  Te)  /  90,  2 

PoP.  =  exp  (-11.2  (  1  -  Rf)2)  /  1  +  —  +  } 

240  1225 

where  *  =  T  -  32  -  90R. 

6  I 

The  resulting  specification  of  PoP1  is  shown  in  Figure  4,  as  a  function  of 
Rj  and  T  .  The  isopleths  of  probability  are  a  fairly  good  approximation  to  those 


INFRARED  EQUIVALENT  TEMPERATURE,  C 


Figure  4,  Probability  of  0.01  in.  of  Precipitation  the  Following 
Hour,  as  a  Function  of  Reflectivity  and  IR  Temperature 


g 

of  Muench  and  Keegan.  The  bending  of  the  isopleths  toward  lower  temperature 
at  very  high  reflectivities  does  not  seem  realistic,  however,  and  probably  indi¬ 
cates  a  small  underestimate  of  probabilities  in  that  region. 

There  are  many  operational  requirements  for  a  vertical  resolution  of  the 
cloud  distribution,  particularly  for  flight  planning.  An  estimate  of  cloud-top 
height  can  be  obtained  by  matching  the  equivalent  IR  temperature  to  some  point 
in  the  vertical  temperature  profile.  With  some  other  plausible  assumptions  one 
could  continue  and  attempt  to  estimate  cloud  bases  and  tops.  Consider  some 
limitations,  however,  if  the  forecasts  are  to  be  verified  by  ground-based  aviation 
reports.  First,  the  accuracy  of  estimated  cloud  heights  is  no  better  than  about 
±20%.  Second,  when  more  than  one  layer  is  present,  the  report  assigns  to  the 
upper  layers  the  sum  of  the  sky  coverage  up  to  and  including  that  layer;  therefore, 
cloud  amounts  of  the  upper  layers  are  often  overestimates  in  the  reports.  In 
view  of  these  limitations,  the  decision  was  made  to  limit  this  Study  to  only  three 
cloud  layers,  low  (bases  below  6500  ft-2000m),  middle  (bases  6500  ft  to 
18000  ft--5500  m),  and  high  (bases  above  18000  ft).  In  addition,  the  forecasts 
would  only  be  made  for  the  presence  or  absence  of  cloud  within  these  layers. 

To  develop  an  algorithm  for  determining  presence  of  low,  middle,  and  high 
clouds,  some  300  simultaneous  cloud -observation  and  satellite  measurements 
were  used,  from  the  same  data  set  used  for  precipitation  probability.  The  cloud 
layers  were  plotted  on  diagrams  of  reflectivity-versus-IR  temperature,  and  some 
fairly  distinct  separations  between  cloud  structures  could  be  seen.  For  example, 
warm,  bright  clouds  were  low  cumuliform  clouds,  and  cold,  not-so-bright  clouds 
were  cirriform.  Figure  5  shows  the  boundaries  for  several  cloud  categories  that 
established  the  algorithm  in  the  forecast  model.  Overall,  the  specifications 
based  on  this  dependent  sample  were  abotrt  70%  correct.  Random  specifications, 
however,  based  on  the  frequency  of  occurrence  (given  some  cloud  is  present) 
would  be  about  50%  correct. 

4.  COMPILATION  OF  TEST  DATA 

4.1  Satellite  Data  Source 

Since  Spring  1977,  GOES  East  Satellite  data  have  been  routinely  archived  at 

AFGL,  using  the  McIDAS  facility.  During  normal  working  hours,  "l-mile" 

visible  and  "4-mile"  IR  digital  values  are  recorded  on  magnetic  tape  for  an  area 

from  Michigan  to  Maine,  and  Quebec  to  North  Carolina  (see  Section  2  of  Muench 
o 

and  Keegan  for  details).  Normally,  the  imagery  data  are  archived  at  hourly 
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Figure  5.  Thresholds  of  Cloud-Layer  Categories  as  a  Function  of  Reflectivity 
and  IR  Temperatures 


intervals,  which  is  a  little  long  for  objective  determination  of  motion  vectors, 
but  on  several  days  during  1978  and  1979  extended  periods  of  half-hourly  imagery 
data  were  recorded. 

Beginning  in  the  Spring  of  1980,  full  disc  imagery,  with  l/2-mile  visible 
and  4 -mile  IR  data  have  been  recorded  routinely  on  the  McIDAS  videotape  cassettes. 
To  save  all  cassettes  for  long  time  periods  would  be  quite  expensive,  and  a  need¬ 
less  duplication  of  a  comparable  effort  at  the  University  of  Wisconsin,  So,  a  30- 
day  rotating  archive  is  maintained,  and  each  working  day  two  30-day  old  cassettes 
are  "written"  over  and  recycled  into  the  file.  At  any  time  up  to  30  days,  one  can 
select  an  area  of  interest  and  times,  and  extract  digital  imagery  data  from  the 
cassettes,  exactly  as  if  the  data  were  being  received  in  real  time.  For  the  pur¬ 
pose  of  this  forecast  test,  the  rotating  archive  allowed  selection  of  test  cases  out¬ 
side  the  northeastern  United  States.  Seven  fixed  areas  were  set  up,  similar  in 
size  to  the  standard  tape  archive.  The  available  storms  were  such  that  only  three 
of  the  areas  were  used  during  the  fall  of  1980.  These  areas  are  outlined  in  Figure  4. 
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4.2  Upper-Level  Winds 


As  previously  explained,  a  current  700-mb  wind  was  needed,  not  only  as  a 
candidate  motion  vector,  but  also  to  smooth  the  first  objectively  determined 
motion  vector  of  each  case.  The  700-mb  winds  were  obtained  from  the  1200  UT 
700-mb  facsimile  chart*  for  the  morning  of  the  case.  Winds  were  obtained  from 
plotted  material  or  reports  at  three  locations  within  the  appropriate  area  (B,  C, 
or  F  in  Figure  6).  The  objective  motion  vectors  were  computed  for  the  same 
locations,  and  the  forecast  routine  used  the  vector  from  the  nearest  of  the  three 
locations  (e.g. ,  radiosonde  stations  BUF,  ALB,  and  DIA  for  area  C).  In  a  few 
instances,  the  700-mb  wind  was  either  illegible  or  missing,  and  either  a  spatial 
interpolation  was  computed,  or  a  geostrophic  calculation  was  made  by  hand. 

4.3  Verification  Data 

The  most  extensive  data  source  available  for  forecast  verification  is  the 
collection  of  hourly  observations  routinely  made  by  airport  observers.  As  part 
of  the  satellite  archive  program,  the  National  Climatic  Center  has  been  providing 
microfische  copies  of  the  MF-1-10(A,  B)  observations  forms  for  25  of  the  United 
States  stations  shown  in  area  C  of  Figure  4.  The  information  on  this  form  is  more 
than  adequate  to  verify  the  forecasts  of  cloud  cover,  rainfall  probability,  and  cloud 
layers.  The  microfische  data  were  not  available  for  the  1980  forecasts  but,  since 
the  spring  of  1980,  the  AFGL  McIDAS  system  has  been  archiving  hourly  reports 
received  from  the  high-speed  FAA  data  circuit  604.  This  weather  data  archive 
includes  both  United  States  and  Canadian  airport  observations,  but  is  not  as  com¬ 
plete  as  the  microfische  from  10  A,  B.  Some  reports  are  missed  due  to  communi¬ 
cations  problems,  and  the  stations  report  precipitation  amount  only  at  3 -hourly 
intervals,  requiring  judicious  interpolation  to  verify  the  hourly  precipitation  prob¬ 
ability  forecasts.  Also,  the  reported  cloud  amounts  may  include  both  "opaque" 
and  "thin"  clouds,  whereas  the  cloud  amount  algorithm  and  the  1979  forecast 
verification  were  based  only  on  "opaque"  cloud  amount. 

4.4  Cane  Selection 

The  principal  application  of  an  extrapolation  technique  would  be  to  cloud 
systems  that  are  moving  steadily,  and  pose  a  threat  of  rapidly  changing  weather 
conditions.  Thus,  the  cases  chosen  for  this  test  contained  cloud  patterns  associa¬ 
ted  with  traveling  cyclone-scale  weather  systems.  Within  these  cases,  orographic 
clouds  are  not  dominant,  if  present  at  all.  Cases  with  extensive  convective 
cloud  systems  were  avoided,  as  the  simple  extrapolation  model  does  not  include 

*  Objective  plot/analysis  prepared  by  the  National  Weather  Service  at  the  National 
Meteorological  Center 
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the  effects  of  the  diurnal  heating  cycle.  Also,  the  model  does  not  have  a  means 
to  discriminate  clouds  from  snow  cover,  so,  midwinter  storms  were  excluded. 
Table  3  summarized  the  cases  included  in  the  study.  The  synoptic  weather 


Table  3.  Cases  Used  in  Weather  Forecast  Test 


Date 

Time 

Images 

Area 

14  Nov  1978 

1700-2000 

6 

C 

15  Nov  1978 

1330-2000 

13 

C 

23  Apr  1979 

1700-1800 

3 

c 

24  Apr  1979 

1330-1800 

10 

c 

25  Apr  1979 

1330-1630 

7 

c 

25  Sep  1979 

1330-2000 

14 

c 

2  Oct  1980 

1330-1930 

13 

F,  B 

17  Oct  1980 

1330-1930 

13 

B 

24  Oct  1980 

1500-1930 

10 

B 

25  Oct  1980 

1400-1630 

7 

F 

3  Nov  1980 

1400-1900 

11 

B 

4  Nov  1980 

1400-1930 

13 

C 

conditions  at  1200  UT  for  each  of  the  cases  are  shown  in  Figures  7a-71.  In  gen¬ 
eral,  the  cases  chosen  represent  the  region  ahead  of  advancing  upper-level 
troughs,  characterized  by  warm-air-advection  ("over-running")  and  extensive, 
though  sometimes  patchy,  cloud  patterns.  Systems  chosen  range  from  fairly 
intense  storms  with  moderate  to  heavy  rain,  to  weak  storms  with  little,  if  any, 
rain. 

4.5  Satellite  Data 

Some  preprocessing  of  the  satellite  imagery  data  was  necessary  before  the 
forecast  program  model  was  run.  First,  the  forecast  stations,  which  numbered 
about  25  to  30,  were  located  within  the  satellite  "row-element"  coordinate  system. 
A  two -stage  navigation  procedure  was  used  that  attains  an  accuracy  of  about  *3  NM 
(5  km). 

Next,  the  visible  channel  measurements  were  converted  to  normalised 
reflectivity.  The  500  x  760  point  arrays  were  split  into  four  sections,  and 
normalization  tables  were  set  up  for  each  sector  following  a  procedure  described 


lynoptic -Scale  Weather  Conditions  for  Each  Weather  Forecast  Test  Case,  24  Apr  1 
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in  Section  2.3  of  Muench  and  Keegan.  The  primary  factor  is  the  secant  of  the 
solar  zenith  angle.  Other  factors  are  the  Increased  reflectivity  of  layer  clouds 
at  low  solar-elevation  angles,  an  anisotropic  scattering  effect,  and  the  small 
effect  of  sun-to-earth  distance,  varying  slowly  throughout  the  year.  In  converting 
the  satellite  visible  "count"  data  to  reflectance,  GOES  calibration  factors  were 
taken  from  Tables  5  and  6  of  Muench. 

The  last  step  in  the  preprocessing  and  data  extraction  was  the  computing  of 
space -averaged  values.  This  averaging  was  done  to  provide  consistency  in  spa¬ 
tial  resolution  between  visible  and  IR  channel  values,  as  well  as  consistency  in 
spatial  resolution  between  N-S  and  E-W  directions.  The  N-S  resolution  of  IR 
channel  data  was  chosen  as  a  standard  grid  size  (about  5. 6  NM  or  10  km  at  40  N). 
Averages  of  4  rows  by  7  elements  of  1-mile  resolution  visible  reflectivities  were 
computed,  as  well  as  averages  of  one  row  by  3-1/2  elements  of  4-mile  resolution 
IR  equivalent  temperature.  Also,  the  standard  deviation  of  reflectivity  over  the 
4x7  array  was  calculated.  The  two  spatial  averages  and  the  standard  deviation 
for  the  resulting  106  x  106  array  were  placed  on  disc  file  prior  to  running  the 
forecast  model. 


5.  FORECAST  AND  VERIFICATION  PROCEDURE 
5.1  Forecast  Model  Execution 

The  forecast  program  was  executed  three  times  for  each  test  case  with  its 
series  of  consecutive  half-hourly  Imagery  data.  The  separate  runs  were  for  the 
700-mb  motion  vector  (alone),  and  for  the  two  runs  when  motion  vectors  were 
computed  from  the  visible  and  IR  imagery  using  the  binary  covariance  technique. 
The  forecast  program,  complete  with  systems  routines,  used  about  62000  (octal) 
CDC  words  of  storage,  and  in  120  seconds  of  CP  time  would  compute  forecasts 
out  to  seven  hours,  at  30  stations,  for  as  many  as  12  images  to  a  case.  For  the 
700-mb  motion  vector  run,  when  the  binary  cross -covariance  routine  was  not 
used,  CP  time  was  cut  in  half.  Examples  from  the  printed  output  for  the  case 
on  25  October  1980  can  be  seen  in  Figure  8,  including  symbols  for  the  weather 
conditions  that  were  observed.  In  addition  to  printed  forecasts,  there  were  also 
forecasts  that  verified  on-the-hour,  and  were  punched  onto  cards  for  later 
verification. 


10.  Muench,  H.  S.  (1981)  Calibration  of  Geosynchronous  Satellite  Video  Sensors, 
AFGL-TR-81-0050,  ADAl028S~4. 
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Table  5.  Percent  Correct  for  Three  Thresholds:  4-Hour  Cloud  Amount  Forecasts 


Technique 

Clear/Scattered 

Scattered/  Broken 

Broken/ Overcast 

700 -mb  M.V. 

0.954 

0.828 

0. 773 

Visible  M.V. 

0.954 

0.827 

0.785 

I-R  M.V. 

0.944 

0.833 

0.784 

Persistence 

0. 943 

0.785 

0.740 

5.2  Forecast  Verification 

The  two  purposes  for  the  forecast  test  were,  first,  to  determine  if  the  simple 
extrapolation  technique  could  produce  useful  short-range  forecasts,  and,  second, 
to  determine  which  of  the  three  motion  vector  techniques  provided  the  best  fore¬ 
casts.  To  judge  utility,  the  best  criterion  for  a  short-range  forecast  is  to  com¬ 
pare  the  forecasts  to  forecasts  made  assuming  "persistence";  in  other  words, 

no  local  change  in  weather  conditions,  Forecasters  characteristically  find  only 

11  12 

small  improvement  over  persistence  with  forecasts  of  less  than  12  hours.  * 

The  motion  vector  technique  that  scored  highest  with  respect  to  persistence  would, 
of  course,  be  judged  to  be  the  best. 

The  cloud-amount  forecasts  were  in  categories,  so  the  verification  program 
produced  4x5  tables  of  forecast  condition  versus  verification,  one  set  of  tables 
for  each  time  period  from  0  to  7  hours.  Besides  the  four  forecast  categories  of 
clear,  scattered,  broken,  and  overcast,  there  was  a  "missing"  category.  For  an 
extrapolation  forecast,  missing  meant  the  upstream  point  was  outside  the  data 
array.  For  persistence,  missing  meant  the  report  at  the  beginning  of  the  forecast 
period  was  missing.  If  the  report  at  the  end  of  the  forecast  period  was  missing, 
there  could  be  no  verification.  When  forecasts  are  used  operationally,  the  cate¬ 
gories  are  not  important  in  themselves  —  a  decision  is  based  on  whether  conditions 
are  expected  to  be  above  or  below  some  threshold.  The  verification  program 
therefore,  computed  percent  correct  relative  to  the  three  thresholds:  clear/scat- 
tered,  scattered/ broken,  and  broken/ overcast. 

The  same  verification  procedure  was  used  for  the  forecasts  of  the  three  cloud 
layers  but,  in  this  case,  there  were  only  three  categories:  yes,  no,  and  unknown. 


11.  Hering,  W.  S.  and  Quick,  D.  L.  (1974)  Hanscom  Visibility  Forecast  Experi 

ments,  Proc.  AMS  Fifth  Conf.  on  Weather  Forecasting  and  Analysis, 
pp.  224-227. 

12.  German,  K.  E.  and  Hicks,  P. ,  Jr.  (1980)  Air  Weather  Service  Ceiling  and 

Visibility  Verification,  Proc.  AMS  Eighth  Conf.  on  Weather  Forecasting 
and  Analysis,  pp.  339-402. 
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Figure  8.  Example  of  Computed  Forecasts  from  Extrapolation  Technique 
for  25  October  1980,  1500  UT 
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The  unknown  category  included  not  only  the  out-of-array  and  misslng-initlal- 
conditlon  situations,  but  also  the  condition  when  an  overcast  of  middle  and  high 
clouds  were  forecast  that  precluded  an  estimate  of  the  low-cloud  status.  (Note: 
This  area  around  reflectivity  of  0.  5  in  Figure  5. )  When  1H  temperatures  are 
equally  cold,  but  the  reflectivity  is  much  higher,  precipitation  is  highly  probable 
with  consequent  formation  of  low  clouds.  There  was  also  an  unknown  condition 
in  the  verification,  representing  the  layer  or  layers  above  an  overcast  sb  seen  by 
the  ground-based  observer.  An  assumption  was  made,  however,  that  middle 
clouds  were  present  whenever  rain  (but  not  drizzle)  was  occurring,  and  high  clouds 
were  present  when  thunder  was  heard. 

1 3 

To  score  the  precipitation  forecasts,  the  "P-score"  was  used.  This  score 
is  defined  by: 

N  <F.  -  ().)2 

p  -  r  — i- — ! — . 

i 


Where  Fj  is  the  forecast  probability  (0.0  to  1.0)  and  is  the  observed  condi 
tion,  either  1.0  or  0,0.  The  "P-score"  represents  a  mean-square  probability 
error,  and  the  lower  the  score  the  better. 


6.  TEST  RESULTS 
6.1  Cloud-Cover  Forecasts 

An  example  of  verification  for  4-hour  forecasts  of  cloud  amount,  an  inter¬ 
mediate  length  forecast,  is  shown  in  Table  4.  If  one  compares  the  numbers,  box 
by  box,  the  numbers,  in  general,  look  quite  similar;  only  when  looking  at  the 
extreme  errors  does  one  note  that  there  were  many  more  persistence  forecasts 
of  clear  and  scattered  that  verified  broken  and  overcast,  than  for  the  motion  vec¬ 
tor  extrapolation  techniques.  The  differences  show  up  a  little  more  clearly  in  the 
threshold  percent  correct  scores,  shown  in  Tab!  . 

Some  improvement  over  persistence  can  be  seen  at  all  tnresholds  for  the 
4 -hour  forecasts.  This  is  not  the  case  for  all  time  periods,  however,  as  can  be 
seen  in  the  plots  of  percent  correct,  versus  time,  for  each  threshold  in  Figures 
9a-9c.  At  forecast  times  less  than  about  2-3  hours,  persistence  is  clearly 
superior,  especially  at  zero  hours.  Since  the  zero-hour  forecast  is  really  a 


13.  Brier,  G.  (1950)  Verification  of  forecast  in  terms  of  probability,  Mon.  Wea. 
Rev.,  78:1-3, 
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specification,  these  results  indicate  specification  accuracy  was  no  better  than 
0.  85  to  0.  92  with  respect  to  the  thresholds.  Since  the  algorithm  was  developed 
on  a  rather  limited  data  sample,  this  might  be  expected.  There  is  also  a  compli¬ 
cation  that  was  overlooked.  The  "on -the -hour"  observations  are  actually  taken 
5  to  15  minutes  before  the  hour,  while  the  satellite  measurements  are  made  2-3 
minutes  (32-33  minutes)  after  the  hour.  Thus,  there  was  a  7-18  minute  error  in 
the  time  interval  used  to  compute  the  motions  of  the  patterns,  a  factor  more  im¬ 
portant  at  the  shorter  forecast  times  when  less  horizontal  smoothing  was  used. 

In  Figures  9a-9c,  the  forecast  scores  of  the  three  motion  vector  techniques 
are  remarkably  similar.  In  fact,  none  of  the  three  can  be  said  to  have  a  clear 
advantage  for  all  thresholds  and  all  forecast  times. 

The  curves  in  Figure  9a  would  seem  to  indicate  that  longer  range  extrapola¬ 
tions  are  more  accurate  than  shorter  ones,  which  is  contrary  to  expectations. 

This  actually  reflects  a  bias  in  the  data  sample.  The  algorithm  has  a  problem 
delineating  between  clear  and  scattered  conditions,  and  since  the  typical  case  had 
advancing  cloud  patterns,  the  upstream  point  from  clear  areas  often  carried  into 
the  cloudy  areas  for  a  7-hour  forecast,  and  the  small  elear-versus -scattered  dis¬ 
tinction  was  not  a  factor. 

There  is  a  very  suspicious  oscillation  in  the  forecast  scores  of  the  extra¬ 
polation  techniques,  with  a  period  of  one  hour.  This  oscillation  was  traced  to  a 
systematic  difference  between  forecasts  made  from  on-the-hour  satellite  data, 
and  on-the -half-hour  satellite  data.  In  the  case  of  the  former,  there  were  more 
initial  conditions  at  low  solar  elevation  angles  when  normalizations  are  less 
accurate. 

Overall,  the  cloud  amount  forecast  scores  for  the  extrapolation  techniques 
relative  to  persistence  must  be  considered  as  quite  encouraging. 

6.2  Probability -of-Pk-ccipitation  Forecaata 

The  P-scores  computed  from  the  four  precipitation  probability  forecast  tech¬ 
niques  are  shown  as  a  function  of  forecast  time  in  Figure  10.  As  with  the  cloud- 
amount  forecasts,  we  see  little  difference  between  the  scores  for  the  three  types 
of  motion  vector.  We  also  see  Bcores  worse  than  persistence  for  short-term  fore 
casts,  and  better  than  persistence  for  longer  forecasts.  The  crossover  for  the 
precipitation  forecasts  appears  between  one  and  two  hours,  slightly  sooner  than 
for  the  cloud-amount  forecasts.  This  shorter  crossover  may  reflect  less  observa 
tional  uncertainty  for  rainfall,  measured  by  an  instrument,  than  for  cloud  amount, 
determined  subjectively  by  an  observer.  Examination  of  individual  forecasts  such 
as  those  in  Figure  8,  suggested  there  was  a  systematic  over-forecast  of  precipita 
tion  probabilities.  This  may  be  due  to  insufficient  compensation  for  differences 
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Figure  10.  P-Scores  of  Four  Precipitation  Probability  Forecast 
Techniques,  as  a  Function  of  Forecast  Time 


between  the  GOES-2  satellite  sensors  used  in  the  algorithm,  and  the  SMS-2 
satellite  sensors  used  in  the  forecast  tests. 

6.3  Qoud-L«yer  Forecaat* 

An  example  of  verification  for  4 -hour  cloud -layer  forecasts  is  shown  in 
Table  6.  One  need  only  look  quickly  at  the  percent -correct  scores  to  see  that 
there  is  no  improvement  over  persistence.  The  percent  correct  are  plotted 
against  forecast  time  in  Figures  lla-llc  for  the  low,  middle,  and  high 
cloud  layers,  respectively.  The  scores  at  zero-hours,  or  specification,  were 
similar  to  those  in  the  algorithm  development  sample,  and  while  the  specifications 
are  somewhat  better  than  chance,  they  are  obviously  worse  than  persistence  for 
virtually  all  time  periods  out  to  7  hours.  These  results  are  disappointing,  and 
indicate  that  the  combination  of  motion  vector  and  algorithm  did  not  predict  the 
observed  condition  as  well  as  did  persistence.  In  the  case  of  cloud  layers,  "a 
good  observation  is  the  best  forecast.  " 
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PRESENCE  (OR  ABSENCE) 
OF  HIGH  CLOUD 


Figure  11a.  Percent  Correct 
Scores  of  Forecast  of  Low  Clouds, 
as  a  Function  of  Forecast  Time 


Figure  lib.  Percent  Correct 
Scores  of  Forecasts  of  Middle 
Clouds,  as  a  Function  of  Forecast 
Time 


Figure  11c.  Percent  Correct 
Scores  of  Forecasts  of  High  Clouds 
as  a  Function  of  Forecast  Time 


7.  CONCLUSIONS 


Without  question,  simple  extrapolation  of  satellite  imagery  patterns  can  pro¬ 
duce  useful  short-range  forecasts  of  cloud  amount  and  precipitation.  In  addition, 

14 

the  results  shown  here  can  easily  be  improved  upon  by  using  better  algorithms 

and  by  refinements  suggested  in  follow-up  examinations.  A  note  of  caution  should 

be  added.  We  still  do  not  know  how  well  a  similar  extrapolation  procedure  would 

have  worked,  using  objective  analyses  of  cloud  amount  and  precipitation  fields, 

rather  than  the  satellite  reflectivities  and  IR  temperatures.  A  study  of  cloud 

advection  techniques  using  airways  observations  and  winds  aloft  was  made  by 
15 

Chisholm.  While  the  results  are  not  directly  comparable  to  those  presented 
here,  the  scores  were  slightly  better  than  persistence  at  3  hours  and  increasingly 
better  at  6,  9,  and  12  hours.  Where  airways  observations  are  plentiful,  the 
satellite  might  not  add  much  independent  information. 


8.  FUTURE  PLANS 

For  the  near  future,  we  intend  to  program  the  simple  extrapolation  model 
(initially  using  700-mb  wind)  to  use  in  real-time  with  the  McIDAS  facility.  With 
this  program,  comparisons  will  be  made  to  subjective  forecasts  as  well  as  those 
from  NWS  model-output-statistics.  Extrapolation  forecasts  of  surface -observed 
cloud  and  precipitation  patterns  will  also  be  possible,  and  such  a  test  would  indi¬ 
cate  the  value  of  satellites  in  data-dense  areas. 

There  are  obvious  limitations  to  the  simple  extrapolation  model.  For  ex¬ 
ample,  difficulty  should  be  expected  with  orographic  and  convective  clouds,  and 
in  winter  there  is  the  snow-cloud  discrimination  problem.  Thus,  efforts  will  be 
made  to  develop  more  generally  applicable  models.  As  a  start,  work  has  begun 
on  a  two-layer  model,  with  the  satellite  data  being  used  to  estimate  condensed 
water  in  each  layer.  The  upper  layer  (about  10, 000  ft  or  3  km)  is  presumed  to 
move  simply,  and  can  be  forecast  by  extrapolation.  The  lower  layer  is  presumed 
to  contain  a  component  that  also  moves  simply,  as  well  as  a  component  that  is 
stationary  and  tied  to  orographic  features.  By  adopting  more  appropriate  param¬ 
eters,  such  as  condensed  water,  one  can  more  easily  include  other  information 
into  the  model  at  a  later  stage,  such  as  radar  reports,  or  products  from  fine- 
mesh  numerical  models. 

14.  Keegan,  T.  J.  and  Niedzielski,  M.  (1981)  The  Specificatton  of  Cloud  Amounts 

over  Local  Areas  from  GOES  Visual  Imagery,  AFgl-TK-81-0153. 

15.  Chisholm,  D.  A.  (1962)  Cloud  and  Ceiling  Prediction  by  Advection  and  by 

Linear  Lag,  Travelers  Research  Center  Tech.  Memo.  1  *!,  35pp. 
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